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A Method and Apparatus for Processing a Predicated Instruction Using Limited 

Predicate Slip 

5 FIELD OF THE INVENTION 

The present invention relates to computer systems and more specifically 
relates to microprocessors using predicated instructions. 

BACKGROUND OF THE INVENTION 

10 

In modern processor designs, one method of increasing performance is 
executing multiple instructions per clock cycle. The performance of such processors 
is dependent on the amount of instruction level parallelism (DLP) exposed by the 
compiler and exploited by the processor. Therefore cooperation between compiler 
15 and processor is increasingly important to achieve higher performance. 

One approach to approved cooperation between compiler and processor is 
using predicated instructions of a predicated execution processor. A predicated 
execution processor is a processor where an instruction is guarded by a Boolean 

20 operand whose value determines if the instruction is executed or nullified. To exploit 
ELP, a compiler can take full advantage of the predicated execution processor by 
applying a technique referred to as if -conversion. In short, if-conversion is an 
optimization that converts control flow dependence into data flow dependence. With 
if-conversion, the compiler can collapse multiple control flow paths and schedule 

25 them based only on data dependencies. Even though a predicated execution model 
exposes more ILP, such a predicated execution model may not always yield enhanced 
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performance. On the compiler side, the predicated execution model requires a 
detailed analysis of the dynamic behavior of the code and the dynamic resource 
availability. Since the effectiveness of predication depends on resource availability, 
the scalability for and compatibility with future-generation processors are important 
5 issues to consider. Given the availability of increasing transistor budgets, increasingly 
more advanced microarchitecture mechanisms can be incorporated. Furthermore, the 
legacy base of predicated code should be able to continue to perform well on future 
processor generations. 

10 One example of an advanced microarchitecture is that of a dynamic, or out-of- 

order, execution processor. An out-of-order, execution processor is, in general, more 
complex than a static execution processor. A static execution processor executes code 
in the order as scheduled statically by the compiler. An out-of order execution 
permits the processor to dynamically adjust instruction scheduling to the run-time 

15 behavior of the program. Because of this ability to adapt to the run-time environment, 
dynamic execution has been employed in many processor designs. The potential 
performance gains of an out of order execution model are facilitated by two 
techniques: Register renaming where registers are renamed to eliminate false 
dependencies and dynamic scheduling where instructions are reordered to reduce 

20 unnecessary stalls in the pipeline. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example and not limitation in 
the figures of the accompanying drawings in which like references indicate similar 
elements. 

5 Fig. 1 illustrates a block diagram of a CPU of one embodiment. 

Fig. 1 A shows one embodiment of an in-order conventional CPU! 

Fig. IB illustrates an in-order limited predicate slip CPU of one embodiment. 

Fig. 1C shows an out-of-order CPU of one embodiment. 

Fig. 2 shows a code sequence of one embodiment. 
10 Fig. 3 A shows a standard in-order CPU algorithm of one embodiment. 

Figs. 3B-3C show an enhanced in-order CPU algorithm of one embodiment. 

Figs. 3D-3E illustrate a limited predicate slip in-order CPU algorithm (with temporary 

result buffer) of one embodiment. 

Figs. 4A-4C illustrate a standard out-of-order CPU algorithm of one embodiment. 
15 Figs. 5A-5C illustrate a limited predicate slip out-of-order CPU algorithm of one 
embodiment. 
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DETAILED DESCRIPTION 

A system and method of processing a predicated instruction is disclosed. A 
consumer instruction and a predicated instruction are received in a reservation station 
5 of an out-order processor. The consumer instruction depends on a result of the 

predicated instruction. The predicated instruction is dispatched to an execution unit 
for execution. The executed predicate instruction is stored in a re-order buffer. 

There are several variations of out-of-order or dynamic execution processors. 
An out-of-order execution processor is shown in Fig. 1. The out-of-order execution 
processor includes a dynamic portion 105 of the processor 100 including a register- 
renaming unit 110, which maps between temporary and architectural files, a reorder 
buffer 120, a number of reservation stations 130, and a number of execution units 140. 
A bus 1 15 couples the register renaming unit 1 10, the reorder buffer 120, the 
reservation stations 130, the execution units 140, and a scoreboard 132 together and to 
the remaining portions of the processor that are not shown. 

In a conventional in-order processor, there are three types of data 
dependencies: read after write (RAW), write after read (WAR), and write after write 
(WAW). Out-of-order (dynamic) scheduling attempts to reduce the stalls of the true 
or RAW dependencies, while register renaming eliminates the false dependencies, 
WAR and WAW, 

Predication is used to transform a control dependency to a (true) data 
25 dependency, that is, the dependency between the write of predicate registers and the 




read of predicate registers for guarding instructions. However, predicate dependency 
is not truly a RAW dependency; predicate dependency has special properties. Unlike 
the roles of other source operands, the predicate does not contribute to the result of the 
instruction computation. However, the predicate dictates whether the result is to be 
5 committed. 

One property of a predicate implies that the predicated instruction can still be 
executed regardless of the value of the predicate since predicate does not alter the 
outcome of the computation. Instead, the predicate determines whether the outcome 
10 is to be used or not used. Predicate slip provides performance improvement by taking 
full advantage of this property of the predicate dependency. 

In principle, the predicate adds another input dependency to the first 
instruction. Unlike other data operands however, the predicate can only assume the 
15 "on" or "off states. In general, an instruction in a processor can only be scheduled 
for execution after all of the instruction's inputs are resolved. In a simplistic 
implementation, a predicated instruction must be stalled until any predicates to the 
instruction are resolved. 

20 A more sophisticated, in-order processor can issue a predicated instruction 

with an unresolved predicate. However, the predicated instruction must stall if the 
predicate is not resolved in the immediately following clock cycle. The stall prevents 
potentially incorrect data from being distributed by the bypass network. As soon as 
the predicate is resolved, the result of the instruction can either be distributed or 

25 discarded, as determined by the predicate, and the correctness of the data is 



guaranteed. 
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One embodiment of an in-order pipeline is shown in Fig. 1 A. The front-end 
160 fetches and decodes instructions. In the register read stage 162 the source 
5 operands are read from the register file 168. A scoreboard 170 indicates if the 

operands are ready. If any one of the source operands are not available the pipeline 
stalls. If an instruction is predicated (i.e. has a guarding predicate), the scoreboard 170 
is checked next for the availability of the guarding predicate. If the guarding predicate 
is available, the guarding predicate is read from the register file 168 location 
10 containing the guarding predicate. If the guarding predicate is not available a simple 
y3 machine would stall the pipeline. An enhanced machine of one embodiment could 

VI postpone stalling due to an unavailable guarding predicate until the completion of the 

S execute stage 164. The execute stage 164 is the last chance of preventing a predicated- 

- off result to be sent to following instructions via a result bypass network. In either 

?p 15 case, a 'false' guarding predicate causes the result of the instruction to be discarded 
p while a 'true' predicate allows the result to be written to the register file 168 in the 

w write back stage 166. 



One embodiment of an in-order pipeline with limited predicate slip is shown 
20 in Fig. IB. The pipeline operates similar to the pipeline described above in Fig. 1 A 
until the register read stage 162. In the register read stage 162 only source operand 
availability is checked. An unavailable guarding predicate does not stall execution. 
After execution, the result is written back to the register file 168, if the predicate is 
known and 'true'. The result is discarded if the predicate is known and 'false'. If the 
25 predicate is still unresolved the result is written back to a temporary result buffer 172 
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(associative buffer). This delays the update of the register file 168 until the predicate 
is resolved. The temporary result buffer 172 allows the pipeline to not stall due to an 
unavailable predicate in the cycle in which the register file 168 needs to be updated. 



5 The illustrated pipelines of Figs 1 A and IB are exemplary only. More 

complex CPUs having multiple concurrent pipelines of varying lengths are also 
contemplated. An important issue to note is that the in-order pipeline issues 
instructions and resolves potential exceptions in-order. After that, the register file 168 
can be updated out-of-order. The scoreboard 170 ensures that there are no out-of-order 

10 multiple writes to the same register. For an alternative embodiment with pipelines that 
must update the register file 168 in-order, for all pending register file writes following 
an unresolved predicate must be buffered in the temporary result buffer 172. 



Fig. 1C shows a pipeline diagram of an out-of-order pipeline of one 
15 embodiment. The front-end 160 operates similar to that described in Fig. IB in an in- 
order machine. The register read stage 162 obtains source operands from the register 
file 168, if available. The schedule/issue stage 174 decides when to execute an 
instruction. An instruction is executed when the scoreboard 170 indicates that the 
corresponding source operands are available. A conventional machine would regard 
20 the predicate as a source operand and prevent the schedule/issue stage 174 from 

issuing the instruction until the predicate is resolved and available. On embodiment of 
a limited slip pipeline ignores predicate availability at the schedule/issue stage 174. 
After execution, the results are written back to the reorder buffer 178. The reorder 
buffer 178 guarantees in-order updates of the architectural register file 168. In the 
25 limited predicate slip method, the reorder buffer 178 also assumes the functionality of 
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the temporary result buffer 172 that was added in the in-order pipeline described in 
Fig. IB above. 



The retire stage 176 is responsible for moving results from the reorder buffer 
5 178 into the register file 168 in-order. If a predicate is unresolved when its result is to 
be written back to the register file 168 all subsequent register file writes are stalled 
until the predicate is resolved. Note that this does not stall the main execution pipeline 
(i.e. stages 160-176) unless the reorder buffer 178 is completely filled up. As 
described in the in-order case above in Figs. 1 A and IB, a 'false' predicate indicates 
10 that the result is to be discarded while a 'true' predicate causes the result to be written 
to the architectural register file. 

It should be noted that the limited predicate slip method is not limited to the 
simple pipeline presented in the above example. More complex out-of-order pipelines 

15 that may contain register renaming, reservation stations and other enhancements are 
also contemplated. Separate reorder buffers and architectural register file are not 
required as long as the ordering of results becoming architecturally visible is 
maintained. Enhancements to the limited slip method depend on the pipeline structure 
and can also include early discarding of instructions with known 'false' guarding 

20 predicates to save execution bandwidth. 

A code sequence of one embodiment is shown in Fig.2. Instruction 1 sets the 
register Rl. Instruction 2 loads R2 from memory and can potentially be a cache miss 
thus delaying the register write. Instruction 3 compares R2 with 0 and sets predicate 
25 PL This can potentially be a multi-cycle operation in highly pipelined machines. 
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Instruction 4 has a guarding predicate PI that determines whether instruction 4 will 
write its result to the architectural registers. Instruction 5 depends on the outcome of 
instruction 4 and therefore indirectly on PI as well 

5 If the predicate PI is unavailable by the time instruction 4 is to be executed, 

the limited predicate slip algorithms, as described in more detail below, will delay a 
pipeline stall as long as possible. In the code example shown in Fig. 2 when 
instruction 5 needs to be executed, due to the dependence described above. Note that 
in real code there can be any number of unrelated instructions in between the ones 
10 shown (1-5). In summary, the following dependencies exist: 

Instruction 3 depends on instruction 2 (R2 data dependency) 
Instruction 4 depends on instruction 1 (Rl data dependency) 
Instruction 4 depends on instruction 3 (PI predicate dependency) 
15 Instruction 5 depends indirectly on instruction 3: 

If PI is true, instruction 5 depends on instruction 4 (Rl data 
dependency) 

If PI is false, instruction 5 depends on instruction 1 (Rl data 
dependency) 

20 

Fig. 3A shows the transition of an instruction from the register read stage to 
execution stage in a standard in-order CPU of one embodiment. For each instruction 
in the register read stage, the availability of the source operands of the instruction are 
checked in process block 302. Alternatively, the "oldest" instruction (i.e. the 
25 instruction that was issued to the register read stage first) is checked first and less aged 
instructions are checked in order of age. The scoreboard is queried to determine if the 
source operands are ready or available. If any one of the source operands are not 
available, then the pipeline is stalled until all of the source operands are available. If 
all of the source operands are available, then the source predicate is checked for 
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availability in process block 304. The scoreboard can also track availability of the 
source predicate. If the source predicate is not available, then the pipeline must stall 
until the source predicate is available. Once the source predicate is available, then the 
instruction can be advanced to the execution stage in process block 306. 

5 

Fig, 3B shows the transition of an instruction from the register read stage to 
execution stage in an enhanced in-order CPU of one embodiment. For each 
instruction in the register read stage, the availability of the source operands of the 
instruction are checked in process block 310. Alternatively, the "oldest" instruction 

10 (i.e. the instruction that was issued to the register read stage first) is checked first and 
less aged instructions are checked in order of age. The scoreboard is queried to 
determine if the source operands are ready or available. If any one of the source 
operands are not available, then the pipeline is stalled until all of the source operands 
are available. If all of the source operands are available, then the instruction can be 

15 advanced to the execution stage in process block 312. 

Fig. 3C shows the transition of an instruction from the execution stage to write 
back stage in an enhanced in-order CPU of one embodiment. For each instruction in 
the execution stage, the availability of the source predicate of the instruction are 

20 checked in process block 314. Alternatively, the "oldest" instruction (i.e. the 

instruction that was issued to the execution stage first) is checked first and less aged 
instructions are checked in order of age. The scoreboard is queried to determine if the 
source predicate is ready or available. If the source predicate is not available, then the 
pipeline is stalled until the source predicate is available. If the source predicate is 

25 available, then the instruction can be advanced to the write back stage in process 
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block 316. 

For one embodiment of a limited predicate slip, in-order CPU, with a 
temporary result buffer, the transition of an instruction from the register read stage to 
5 execution stage is substantially similar to that described above in Fig. 3B. Fig. 3D 
shows the transition of an instruction from the execution stage to write back stage in a 
limited predicate slip, in-order CPU, with a temporary result buffer. For each 
instruction in the execution stage, the availability of the source predicate of the 
instruction are checked in process block 320. Alternatively, the "oldest" instruction 

10 (i.e. the instruction that was issued to the execution stage first) is checked first and 
less aged instructions are checked in order of age. The scoreboard is queried to 
determine if the source predicate is ready or available. If the source predicate is not 
available, then the result of the instruction is written back to the temporary result 
buffer in process block 328. Alternatively, the temporary result buffer can be checked 

15 to determine if the temporary result buffer is full, as shown in process block 326, 

before the result is written back to the temporary result buffer. If the source predicate 
is available in process block 320, then the instruction can be advanced to the write 
back stage in process block 322 and the scoreboard is cleared in process block 324, 

20 Fig. 3E shows the processing of an instruction in the temporary result buffer. 

For each instruction in the temporary result buffer, the availability of the source 
predicate of the instruction are checked in process block 330. Alternatively, the 
"oldest" instruction (i.e. the instruction that was issued to the temporary result buffer 
first) is checked first and less aged instructions are checked in order of age. The 

25 scoreboard is queried to determine if the source predicate is ready or available. If the 
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source predicate is not available, then the temporary result buffer is not updated (i.e. 
updates are stalled) in process block 330. Next, the source predicate is tested to 
determine if the source predicate is true in process block 332. If the source predicate 
is true, then the result of the instruction is written to the register file in process block 
5 334. If the source predicate is not true in process block 332, then the result of the 
instruction is discarded in process block 336 and the scoreboard entry for the 
instruction is cleared in process block 338. The entry in the temporary result buffer 
for the instruction is also cleared in process block 340. 



10 Figs. 4A-4C illustrate a standard out-of-order CPU algorithm of one 

embodiment. First, Fig. 4A shows the transition from issue stage to execution stage. 
For each instruction in the issue stage, checking the scoreboard for the status of the 
source operands checks the source operands for availability in process block 400. If 
the source operands are not ready, then the pipeline is stalled until all of the source 

15 operands are available. If the source operands are ready (available) then the source 
predicate is checked for availability in process block 402. If the predicate is not 
available, then the pipeline is stalled until the predicate is available. When the 
predicate is available, the instruction is issued to the execution stage in process block 
404. 

20 

Fig. 4B shows the transition from execution stage to retiring the instruction. 
The result of the executed instruction is written back to the reorder buffer in process 
block 408. The reorder buffer can later retire the instruction in order. Alternatively, 
the reorder buffer can be checked to determine if the reorder buffer is full in process 
25 lock 406 before the result of the instruction is written back to the reorder buffer. If 
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reorder buffer is full then the pipeline is stalled until the reorder buffer is no longer 
full. Once the result is in the reorder buffer, the status of the instruction is cleared 
from the scoreboard in process block 410. 

Fig. 4C shows the processing of the instruction in the reorder buffer. If the 
result of the instruction is not ready in process block 420, then the update of the 
reorder buffer is stalled until the result is ready. If the result of the instruction is ready 
in process block 420, then the result is written to the register file in process block 422 
and the entry in the reorder buffer is cleared in process block 424. 

Figs. 5A-5C illustrate a limited predicate slip out-of-order CPU of one 
embodiment. Fig. 5A illustrates the transition from issue to execution of one 
embodiment. For each instruction in the issue stage, the availability of the source 
operands of the instruction are checked in process block 500. Alternatively, the 
"oldest" instruction (i.e. the instruction that was issued to the register read stage first) 
is checked first and less aged instructions are checked in order of age. The scoreboard 
is queried to determine if the source operands are ready or available. If any one of the 
source operands are not available, then the pipeline is stalled until all of the source 
operands are available. If all of the source operands are available, then the instruction 
can be advanced to the execution stage in process block 502. 

Fig. 5B shows the transition from execution to retiring the instruction in a 
limited predicate slip, out-of-order CPU of one embodiment. The source predicate is 
checked for availability in process block 510. If the predicate is available, then the 
25 result of the instruction is transferred to the reorder buffer in process block 514. 
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Alternatively, the reorder buffer can also be checked to determine if the reorder buffer 
is full, before the result is transferred to the reorder buffer in process block 512. Once 
the result of the instruction is transferred to the reorder buffer, the status entry for the 
instruction is cleared from the scoreboard in process block 516. 

5 

Fig. 5C shows one embodiment of processing the instruction in the reorder 
buffer in a limited predicate slip, out-of-order CPU. For each entry in reorder buffer, 
processed in order, the result of the instruction is checked for availability in process 
block 528. If the result is not ready, then the update of the reorder buffer is stalled 

10 until the result is ready. If the result is ready, the source predicate is checked for 

availability in process block 530. If the source predicate is not ready, then the update 
of the reorder buffer is stalled until the source predicate is ready. If the source 
predicate is ready, then the predicate whether the predicate is true or not is determined 
in process block 53. If the predicate is true, then the result of the instruction is written 

15 to the register file in block 534. The scoreboard is then cleared in process block 536 
and the reorder buffer entry for the instruction is cleared in process block 538. If the 
predicate is false (not true) in process block 532, the result of the instruction is 
discarded in process block 540 and the scoreboard is then cleared in process block 536 
and the reorder buffer entry for the instruction is cleared in process block 538. 

20 

It will be further appreciated that the processes represented by the blocks in 
Figs. 3A-5C are not required to be performed in the order illustrated, and that all the 
processing represented by the blocks may not be necessary to practice the invention. 

25 In the foregoing specification, the invention has been described with reference 
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to specific exemplary embodiments thereof. It will be evident that various 
modifications may be made thereto without departing from the broader spirit and 
scope of the invention as set forth in the following claims. The specification and 
drawings are, accordingly, to be regarded in an illustrative sense rather than a 
restrictive sense. 



